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Abstract 

In this paper we study the N-player nonzero-sum Dynkin game {N > 3) in continuous 
time, which is a non-cooperative game where the strategies are stopping times. We show 
that the game has a Nash equihbrium point for general payoff processes. 
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1 Introduction 

A Dynkin game is a game where the controllers make use of stopping times as control 
actions. Actually assume one has N players denoted by 7ri,...,7rjv and each of which is 
allowed, according to its advantages, to stop the evolution of a system. The system can be 
for example an option contract which binds several agents (players) in a financial market. 
So for i = 1, ■■■,N, assume that the player vTj makes the decision to stop the system at r^, 
then its corresponding yield is given by: 

Mn, • • • ,r^) := E[X;i|,^<«^| + Q'^J{n=R.} + yRMn>B..}] (1-1) 

where Ri := min{rj,j ^ i} and X^,Q^,Y^ are stochastic processes described precisely 
below. This yield depends actually on whether tTj is the first to stop the evolution of the 
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system or not. So the main problem we are interested in is to find a Nash equihbrium point 
(hereafter NEP for short) for the game, i.e., an A^-uplet of stopping times (rj*, ...,r^) such 
that for any i = 1, N , for any Tj, 

A NEP is a collective strategy of stopping for the players which has the feature that if 
one of them decides unilaterally to change a strategy of stopping then it is penalized. 

In the case when N = 2 and Ji + J2 = 0, the game is called of zero-sum type and 
the corresponding NEP is called a saddle-point for the game. Otherwise it is called of 
nonzero-sum type. 

The first works related to Dynkin games, which concern mainly the zero-sum setting, 
go back to several decades before (see e.g. [2, 3, 8, 11, 16, 17, 20, 25, 21, 27], etc. and the 
references given there). This latter setting was revisited several years later by many authors 
especially in connection with reflected backward equations [6] , the pricing of American game 
contingent claims introduced by Y. Kifcr (see e.g. [15, 12, 14, 18], etc.), convertible bonds 
(see e.g. [5, 24]) or other reasons ([19, 26]), etc. 

In comparison, nonzero-sum Dynkin games in continuous time, introduced by Bensous- 
san and Friedman in [1] have attracted few research activities (see e.g. [1, 4, 10, 13, 23], 
etc.). Moreover, on the one hand, those papers deal with the case of two players (even in 
[1]) and, on the other hand, the assumptions on the data of the problem are rather tough 
since, except a recent paper by S.Hamadene and J.Zhang [13], authors assume that e.g. the 
processes of (1.1) are supermartingales. Even in the discrete time setting, this latter 
assumption is supposed (e.g. in [22]). 

So the main objective of this paper is to study the continuous time nonzero-sum Dynkin 
game in the case when there are more than two players and general stochastic processes X* , 

and Q^, i = 1,...,N. The processes are no longer supposed being supermartingales. 
We actually show this game has a Nash equilibrium point under minimal assumptions. We 
should point out that according to our best knowledge this problem has been not considered 
yet and the generalization from the two-player setting to the multi-player one, even with 
respect to the work by Hamadene- Zhang [13], is not formal and raises questions which are 
far from to be obvious, especially the construction of the approximating scheme and the 
study of its properties. 

This paper is organized as follows. In Section 2, we set accurately the problem, recall 
the Snell envelope notion and provide a result (Prop. 2.1) which is in a way the streamline 
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in the construction of the of the NEP of the nonzero-sum Dynkin game. The approximating 
scheme and its main properties are introduced in Section 3. Finally in Section 4, we show 
that the limit of the approximating scheme is a NEP for the game. ■ 

2 Setting of the problem and hypotheses 

Throughout this paper T is a positive real constant which stands for the horizon of the 
problem and (Q, J-", V) is a fixed probability space on which is defined a filtration F := 
{J-t)t<T which satisfies the usual conditions, i.e., it is complete and right continuous. 
Next for any stopping time 9 <T, let us denote by: 

(i) To the set of F-stopping times r such that P-a.s. r G [0,T]; 

(ii) Eg[.] the conditional expectation w.r.t. Tq, i.e., E^/fX] := E[X|J^5)], for any integrable 
random variable X ; 

(iii) J^:= {l,...,iV}. 

Next an F-progressively measurable iR-valued stochastic process {Ct)t<T is called of class 
[D] if the set of random variables {Cn r G To} is uniformly integrable. Now for i = I, ...,N, 
let us introduce F-progressively measurable and iR-valued stochastic processes of class [D] , 
X' := {Xl)t<T, ■= iQt)t<T and V := {Y^)t<T, which moreover satisfy the following 
hypotheses: 

Assumption 2.1 ; For any i = 1, . . . ,N, 

(Al).- X'^ is right continuous with left limits (RCLL for short) and does not have negative 
predictable jumps ; 

(A2); The process is right continuous, i.e., P-a.s., for any t <T, = limg\^f and 
of class [D]. As a consequence if (7n)n>o is a decreasing sequence of ¥ -stopping times then 

(A3).- The processes X"^ , y and verify: 

P - a.s. \ft < T, Xi <Qi< Yi; 

(A4).- For all t eTo, P-a.s. 

N 

iQl<Y;;T<T)cf]{Xi<Y^). 
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Note that assumptions (A1)-(A3) are minimal in order to solve the problem, as for [A4], 
it is satisfied for e.g. for any i ^ J and r G To, P-a.s. on (r < T): X* < or Q'tj. = Y^. 
■ 

Next for Ti, ■ ■ ■ , T^v elements of To and for i & J, let us define Ji{Ti,T2, ■ ■ ■ , Tjv), 
the payoff associated with the player i, as follows: 

Ji{Ti,T2, ■■■,Tn) := E|x^.l{T.<i^.} + QTA{Ti=Ri} + YR.l{Ti>Ri}}- (2-1) 
where Ri := min{T,-,j ^ i} = Aj=i^N;j^iTj. 

The meaning of those payoffs in this nonzero-sum Dynkin game framework is the following: 
Assume that for any i = 1, ...,N, the player m makes the decision to use the stopping time 
Tj as a strategy of stopping. Let io G J', then: 

- TTjQ will receive an amount equal to X^' if it decides unilaterally to stop controlling 
first. As for the other players ttj, j / io, each one will receive an amount which equals to 

yj . 

Jig 

- TTjy will receive an amount equal to Ql^_ if there is a commitment with one or more 
other players to stop first the game. Each one of the players j which do not get involved in 
the commitment will receive Y^ . 

We next precise the notion of equilibrium that we are looking for. 

Definition 2.2 We say that (Tj*, T|, • • • , T^) € 7o^ is a Nash equilibrium point of the 
Nonzero-sum Dynkin game associated with {Ji)i£j if for alii = 1, - ■ ■ ,N and allTi, - ■ ■ , Tjv G 
To we have: 

T fT^* rji* rp rp* rp* \ ^ J ^T^* rp* rp* rp* rp* \ ( r\ c\\ 

'JiK-'-ir " j-'-i-lj-'-i-i-'-i+l-i' " -iJ-N) ^ 'JiK-'-li' " i-'-i-li-'-i ) -'i+l) ■ ■ ■ ) -'wj- l^-^j 

The definition means that when the equilibrium is reached, is penalized each one of the 
players which makes the decision to change unilaterally its strategy of stopping. □ 

Next to begin with we give a result which in way is a streamline in order to construct 
a NEP for the nonzero-sum Dynkin game. Actually we have: 

Proposition 2.1 Assume there exist N stopping times (r*)i=i_jv and N F -progressively 
measurable RCLL processes (W^')i=i,Ar, such that for any i = 1,...,N, if we set Ri = 
Ti A ... A r*_i A T*_^_i A ... A rj^ and R = r*A... A rj^ = t* A Ri then: 

(i) {Wt/\R)t<T is an Y -martingale and iWthRi)t<T is an ¥-supermatingale, 



4 



(n) yt<T, VF/l{i<Hj > Xll^.^n^] and H^;.l{,;<^,} = X;.l|,.<^^}, 
(in) W}^ = y41{R,<T} + Q^l{i?,=r} and {Y^ - Q^j,^)!^^^^,,^^} = 0- 

Then the N-uplet of stopping times (r*)j=i^Ar is a Nash equilibrium point for the nonzero- 
sum Dynkin game associated with {Ji)i£j- Moreover for any i £ J', 

Ji((r*),=i,iv) = E[Woi- 
Proof: Actually for any i £ J ^ since (W^tAi?)*<T is a martingale then 

But taking into account the equaUties of (iii) we get: 

= (^Al{K«<r} + (3t1{R>=t})1{t*=/?,} + (^41{i?,<r} + <3Tl{Ri=r})l{T*>i?i} 

Making now the substitution in (2.3) we deduce that: 

On the other hand since (W^/^j^)t<T is an F-supermatingale then for any stopping time 
7 G To we have, 

But once more 

= (^k'^{R^<T} + <5rl{R>=T})l{7=i?,} + (^41{i?,<T} + QTl{iii=r})l{7>Ri} 

> Q'ji^l{^=R^} + F4Il{^>Kj 

since y* > Q*. Plugging now this last term in (2.4) and since W^l.^^^ji.y > we 
obtain: 

MTt,...,T*^)=E[W^] 

> E[X;i{^<^} + Q|,^1{^=^,} + y4l{^>^}] = J,(rr,...,rti,7,r*,i,...,ri^). 
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Thus the A^-uplet of stopping times (Tj*)i=i^iv is a Nash equihbrium for the nonzero-sum 
Dynkin game. ■ 



To tackle the game problem, we mainly use the notion of SncU envelope of processes 
which we introduce briefly now. For more details on this subject one can refer e.g. to 
El-Karoui [9] or Dellacherie and Meyer [7]. 

Theorem 1 ([7], pp. 431 or [9], pp. I4O) : Let U = {Ut)o<t<T be an F-adapted M-valued 
RCLL process that belongs to class [Dj. Then there exists Z := {Zt)o<t<T an F-adapted 
M-valued RCLL process of class [D], such that Z is the smallest super-martingale which 
dominates U, i.e, if {Zt)o<.t<T is another RCLL supermartingale of class [D] such that 
Z >U then Z > Z, P-a.s.. The process Z is called the Snell envelope ofU. R satisfies the 
following properties: 

(i) For any F -stopping time 9 we have: 

Ze = esssnY>F[Ur\Te\ {and then Zt = Ut) ■ (2.5) 

(a) If the predictable jumps of U are only positive, then the stopping time 

T* = inf{s > 0, Zs = Us} 

is optimal, i.e., 

F[Zo] = F[Zr*\ = B[Ur*] = supEpr]. (2.6) 

T>0 

Remark 2.3 As a by-product of (2.6) we have Z^* = Ur* and the process (^tAr*)t<T is a 
martingale. ■ 



3 The approximating scheme and its properties 

We arc now going to introduce sequences of stopping times which, as we will show it later, 
converge to a NEP of the game. So let us consider the sequence of F-stopping times (r„)„>i 
defined, by induction, as follows: 

(i) Ti = ---TN = T. 

(ii) For n > A/" + 1, let {i, q) = {in, Qn) e -fV^ be such that n = Nq + i with l<i<N. Then 
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let us set: 



- 6'n = min{Tn_i, rn_2, • • • , Tn-N+l} ; 

- = + y^„l{t>e„} with y/ = Q^l{,=r} + y/l{t<T}, Vt < T; 

- yt<T, Wr = esssup.gT-^ E[i7-|J^t] ; 

- fin = ini{s>Q,W^ = Un; 

- Tn = {lln A ■'■n-Ar)l{;i„AT„_iv<6'n} + '^n-Jvl{|U„AT„_iv>6'n}- 

Remark 3.1 As a direct consequence of the above definitions and the properties of the Snell 
envelope, the following relations or properties hold true: for any n > N + 1, 
(i) W"' is RCLL and for any t > On, 

(n) 

fJ'n < (^n, Tn < Tn-N and On < On-N', 

(Hi) since the predictable jumps ofU^ are only positive and taking into account Assumption 
(A3), we deduce from Theorem l-(ii) that /x„ is optimal, i.e.. 

Era = nwjij = nu;j = supE[[/;]. 

T>0 

(iv) Let n = Nq + i where the pair {i,q) is as above, therefore even if this is not explicitly 
mentioned in the definition, the stopping time On = Omq+i depends on i. The same happens 
for [/", Tn, Hn and W. □ 

Additionally we have: 

Proposition 3.1 For any n>l, Hn+N < Tn, P-a.s.. 

Proof: Actually suppose there exists m > 1 such that P[Tm < Hm+N] > and let us set 
n = min{m > 1 s.t. P[Tm < /^m+iv] > 0}. Then we obviously have ra > iV + 1. Next on the 
set {Tn < fJ-n+N} we have: 

Tn < dn+N '■= Tn+N-1 A Tn+N-2 A • • • Tn+1 (3.1) 

since fJ-n+N < On+N (Rem.3.1-(ii)). But the definition of n implies that fin+N-i < Tn-i and 
then 

Tn+N-l = /^n+Ar-ll{^„+jv_i<6(„+jv-i} + ■'■n-ll{/^„+Jv_l=6»„+Jv-l} 
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and from (3.1) and the definition of 9n+N-i we deduce that 9n+N-i = Tn- It follows that: 

Tn+N-l = /^n+Ar-ll{/i„+jv-i <Tn} + '''n-l'^{ij,„+N-i=T„} 

Therefore 

Tn < Tn+N-l = Tn-l- (3.2) 

The strict inequality stems from (3.1) as for the equality it holds true since jin+N-i ^ 
dn+N-l = Tn and Tn < Tn+N-l- 

Next 

On+N-2 ■= Tn+N-3 A Tn+N-A A • • • T„+i A r„ A r„_i = T„ 

since from (3.1) for any k = 1, — 1 we have r„ < Tn+k from (3.2) t„ < t„_i. But 
once more the definitions of n and Tn+N-2 imply that: 

Tn+N-2 = Hn+N-2'i-{n„+j^_2<Tn} + '^n-2l{,,„+jv-2=T„} 
As we know that Tn+N-2 > Tn then Tn+N-2 = Tn-2 > Tn- 

Repeating now this procedure as many times as necessary we deduce that for any j = 
1,...,N-1, 

Tn ^ Tn+N—j — Tn—j 

and then on the set {r„ < Hn+N} we have 

Tn < Qn+N = dn 

and thanks to the definitions of n and r„ we also have on F := {r^ < Hu+n} 

Tn = /^nl{^„<0„} + Tn-N'i-{i^„=e„} = fJ-n 

since fj,n < Tn-N- Therefore on the set T G we have = U^+^ since On+N — &iid 
lrW^;+^ = ^tW^:^'' = Ir esssup,gr.„ mr^'lJ'rJ = esssup,er.„ E[ILrC/r^l-^rJ 



= esssup^gT;^ E[ILrt/v l-^T, 
= IrW. 



/in 

i.e., Ir^''^/"^^ = ^rUJ]^^ and then fin+N < /^n on F since fin+N is the first time that 
l^n+Af j-cachcs [/"+^. As on F we have /i„ = t^ < Hn+N then this is contradictory with 
the previous inequality. It follows that -P[F] =0 and for any m > 1 we have Hm+N < Tm, 
P-a.s.. The proof is complete. ■ 

As a by-product we obtain: 



Corollary 3.2 For any n > N + 1, 

(i) Tn = /^nl{;,„<e„} + Tn-Arl{^„=e„} / 

(a) Hn = Tn /\9n = Tn h Tn-l A • • • Tn-N+l- 



Proof: Indeed, (i) is a direct consequence of the previous proposition and the definition of 
Tn- As for (ii), we have 

TnA^n =TnT^{Tn<0n}+^nT^{rn>0n}- 

But r„l{^„<0„} = ;U„l{^„<e„} and on [r„ > 9n] wc have 9^ = Therefore 0„IL{^^>0^} = 
//„l|^^>g^}. Gathering now those relations yields = Tn /\9n- Finally the second equality 
is just the definition oi 9n- ■ 



4 Existence of a Nash equilibrium point 

For any i G {1, • • • , N}, let us define: 

T* = lim TNn+i and R* = lim 9Nn+i = min{T* ; j / i}. 

Those limits exist since for any n > A?^ + 1, we know that r„ < Tn-N therefore the sequences 
{TNn+i)n>o ^rc non-increasing for fixed i. 

We have also, for alH G {1, • • • , N} 

R* :=T^ A-- - AT^ = lim /iNn+i = lim /x^-^ 



We are going now to show that the A^-uplet of stopping times (7i*)j=i^...^7v is a Nash 
equilibrium point for the N-players nonzero-sum Dynkin game associated with (Jj)igj-. 
The proof will be obtained after several intermediary results given below. 



Lemma 4.1 For any n > 1, i G {1, • • • , N} and any 9 G % we have: 

JiiTNn+N+l,TNn+N+2, ' ' ' , TNn+N+i-1, 9 , TNn+i+1, ' ' ' ,TN"n+Jv) 

< Ji{TNn+N+l,TNn+N+2, ' ' ' , TNn+N+i-1, TNn+N+i, TNn+i+1, ' ' ' , TATn+w) 
'^^[O^TNn+N+i ~ ^T-JVn+JV+i ) ^{'''Nn+N+i=dNn+N+i<T}]- 
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Proof: For any n > 1, i € {1, ■ ■ ■ , N} and 9 € To, 



(4.3) 



Ji{rNn+N+l,TNn+N+2, ' ' ' ,TNn+N+i-l,d,TNn+i+l, ' ' ' ,TNn+N) 

But 

and since < we have 

Qe^{e=eNn+N+i} + ^eNn+N+i^{S>^Nn+N+t} 

< {Q'j,l{g^^^^^^=T} + ^eNr^ + N + ^^{T>^Nr.+N+i})^{0>9Nu+N+^} 

^ TyNn+N+i-n 

Therefore 

Ji{TNn+N+l,rNn+N+2, ' ' ' ,TNn+N+i-l,d,TNn+i+l, ' ' ' ,TNn+N) 

since ]/^^"'+-^+» is a supermartingale. 
Next 

Ji{TNn+N+l,TNn+N+2, ' ' ' , TNn+N+i-l, TNn+N+i, TNn+i+l, ' ' ' ,TNn+N) 

_ T^iTj-Nn+N+i 1 _|_ Trrf/^i —V* 'ill/ \1 

I- rNn+N+i/\9Nn+N+i' ^^^0Nn+N+i ^ONn+N+i' ^{TNn+N+i=ONn+N+i<T)i 

= + HiQdNn+N+i ~ ^eV„+iv+i) ^{rjv„+iV+i=eAr„+Ar+i<T}] (4-4) 

= E[H^o^"+^+*] + E[(Q^^^^^^. - l{T^„+^+i=e^„+^+,<T}] 

since tnu+n+i A 6lAr„+Ar+i = UNn+i+i (Cor. 4.1-(ii)), (W^tAjI^^t+i)<<T a martingale (Re- 
mark 2.3) and finally by (i) of Remark 3.1. Comparing now (4.3) and (4.4) to obtain the 
desired result. ■ 

We now focus on the limits of the terms that appear in the inequality of the previous 
lemma. 

Lemma 4.2 .■ The following asymptotic inequalities hold true: 
(i) For all 6 ^ To and i ^ J , we have: 

lim„_^oo Ji{TNn+N+l,TNn+N+2-, ' ' ' ,TNn+N+i-l,d,TNn+i+l, " " " jTMu+n) = 

n>0 



10 



(ii) 



li™:n-)-oo (yJi{jNn-\-N-\-l-,TNn->rN-\-2-, ' ' ' ,TNn+N+i-l,TNn+N+i,TNn+i+l, ' ' ' ,TNn+N) + 

I I ^ I 1 J 

linin^OO -Y^*) ^{TNn+N+i<0Nn+N+i,T*=R*<T}]- 



Proof: (i) Actually 



Ji{TNn+N+l,TNn+N+2, ' ' ' , TNn+N+i-1, O , TNn+i+l, ' ' ' ,TNn+N) 

(4.5) 

As the process is RCLL and of class [D] and the sequence {ONn+N+i)n is decreasing then, 
when n oo, 



E[^^l{e<eA,„+iv+i} + ^0Ar„+Ar+il{(?>ejvn+jv+i}] ^ E[X^l{e<K.} + y^.l{0>R.}]. (4.6) 



On the other hand, when n ^ oo. 



E[(Q^ - Xl)\^e=e^^^^+,}] ^ E[(Q^ - X'm{e=Ri}\ - n{Ql - 1 Q ^ ^* < ^^^^.)]- 

n>0 

(4.7) 

Actually (4.7) is obtained in paying attention whether the sequence {9Nn+N+i)n is of sta- 
tionary type or not. Going back now to (4.5), take the limit and make use of (4.6) and (4.7) 
to obtain the desired result . □ 
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Next let us focus on (ii). Let i & J' he fixed, then: 



lim„_^oo \^Ji{TNn+N+l,T]srn+N+2, " " " ,TNn+N+i-l,TNn+N+i,TNn+i+l, ' ' ' ,'''Nn+N) + 

— iiiikn-^OO ■'^[■^TNn+N+i {TNn+N+i<dNn+N+i} ' Onu+N+i {'rNn+N+i>ONn+N+i}' 

6Mn+N+i {'''Nn+N+i=ONn+N+i<T} ' ^5T "-{TNn+N+i=dNn+N+i=T}i 

— li™;n->.oo -^[^Tjv„+Af+i ^{'rNn+N+i<dNn+N+i; T^<Ri} "'"^jVn+JV+i ^{'^Nn+N+i>dNn+N+i; T*>R*} 

+YeNn+N+i MrNn+N+i=0Nn+N+i;T*=R*<T} + Qt Ht*=R*=T}] 

= E[X^, l{T.*<i?n + Qt* l{r*=i?n + ^r* ^{t*>r*}] — ^{Qt* ^{t*=r*<t}]+ 

^n-^OoE[XJj,» ^{TNn+N+i<eNu+N+i;T*=R*} + ^R* '^{TNu+N+i>eNn+N+i\T*=R*<T}\ 

= Ji{Ti,T2, ■■■ , T*_i,T*,Tl^^, ■■■ , T^) + E[{Y^, - Q\,*) 1{t*=r*<t}]+ 

linin^OO -Yj,,) T^{TNn+N+i<ONn+N+i,T*=R*<T}] 

which is the desired result. Note that in the fourth inequality we have taken into account 
the fact that the processes and are of RCLL and of class [D] . ■ 

An obvious consequence of Lemmata 4.1 and 4.2 is: 
Corollary 4.1 For all 9 &Tq and all i e J 

T (rp* /Tl* rp* n rp* rp* \ IT' T/'/^j ^ H 1 

n>0 

< Ji{T^,T^, ■■■,TU,T*,T*^„---, T^) + E[{Yi. - Q^.) l{T;=ii*<T}] 

+ lim„_^oo - l{rjvn+jv+z<ejv„+JV+z, T*=R*<T}\- ■ 

(4.8) 

Lemma 4.3 (i) We have: 

Jim^E[(X^* -y^.) ^{TN^+^+i<et,n+N+uT*=Rl<T}\ =0 

and then for all e > 

lim P[Yrp* — Xj'* > £, TNn+N+i < 0Nn+N+i, T* = R* < T] = 0. 



12 



(a) For all 9 ^ To and all i ^ J , 

MTt, r|, • • • , T*_„e, • ■ • , n) + myk* - Q%*) Me=R*<T}] 

< MTt,T^, T^„T*, T*_^l ■■■,tI) + E^y^. - Q'^p l{T*=ii:<T}]- 
Proof: (i) Actually let 6 be the following F-stopping time: 

6 = T* \{T*<R*} + T l{r*>ii*}- 
Then using inequality (4.8) yields: 

n>0 

= Ji(T^,T^, ■ ■ ■ ,T*_^,T*,T*_^^, ■ ■ ■ ,T^) + E[{Y;^, - Q^.) If^j^^^ji*^^^] 

< Ji (Tf ,T^, - ■ ■ ,T*_^,T*, T*_^^ , • • • , T^) + E [(y^. - Q'ij., ) Ij^. = r* <r}] 

+ limn^.ooE[(X^. -^^0 l{rAr„+jv+i<0jVn+JV+i,T;*=R*<r}]- 

Hence 

which completes the proof since XL, — Yi.* < thanks to Assumption (A3) . 

i i 

(ii) Let 9 be the following F-stopping time: 

9 = 9 1{6I=_R*<T)<= + T 1{6I=R*<T} 

where the superscript C^) stands for the complement. Since P[9 = Rf < T] = we obtain 
from (4.8) and (i), 

J,(Ti , , • • • , T,_i , 9, T,+i , • • • , T^) - E[(Q~ -X~)l^^~^ ^ ^^^^^-^J 

n>0 

= Ji{Tf,T^, ■ ■ ■ ,T*_^,9,T*_^^, ■ ■ ■ ,T^) + E[{Y}^, - Q"-^,) ^{e=R*<T}\ 

t t ^ ^ 

< Ji{Tf,T^, • • • , i^*, • • • , r;^) + ^[(y^* - Q}^*) 1{t*=r*<t}], 

whence the desired result. ■ 

We now give a key-result which allows us to conclude. 
Proposition 4.1 Under Assumption (A4), for all i e J we have: 

E[{Yi., - Q^.) l{T.*=ii*<T}] = 0. (4.9) 



13 



Proof: First note that for any i £ J we have: 

E[(y^, -Q^.)i{T*=ii*<T}] < 

7={ji,...,i/;}C>7, iEl and k>2 

where = min{T* ; j ^ 1} with min0 = T. Therefore it is enough to show that for any 
ii, ifc G JT", which we assume w.l.o.g satisfying ii < i2 < • • • < ik, we have: 

^lO^T* ~ '5r.*)^{T.* =T.* =---=T/^<ilJ}] = 
for any i € I = {h, ■ ■ ■ ,ik}- 
Step 1: For any n > 0, 

k 

P[An := fl {R*i > TNn+i, > 0Nn+i,}] = 0. (4.10) 

Actually, first note that P[Aq] = P[Ai] = 0. Next let us show that An C An-i for any 
n > 2. 
On An. 

By the definitions of r„ and R}, we have: Vj G {1, ■ ■ ■ , k}, \fa ^ /, 

TNn+ij = TN{n-l)+ij and TNn+ij < R*I < TNn+a < Tjv(n-^)+a, ^ > 0. (4-11) 

Therefore in using those properties we deduce that: 

dNn+ij '■= TNn+ij-1 A TNn+ij -2 A • • • A TNn+ij-N+1 

= TNn+ij-i A TNn+ij-2 A • • • A TNn+h A TNn+ik-N A TNn+ik-i-N A • • • A TATn+ij+i-Af 

(4.12) 

Let us give briefly the justification of the second equality. Indeed for some £ G {1, N — 1} 
either ij — £ > or ij — £ < 0. Case (i): ij — £ > 0. Then if — £ G {ii, then we 
keep it in the expression of ONn+ij and if ij — £ ^ {ii, then we know from (4.11) 

that, e.g., TNn+ij-i > TNn+ij-i ^nd then TNn+ij-i is deleted from the expression of ONn+ij- 
Case (ii): ij — £ < 0. Then TNn+ij-e = TN(n-i)+ij-e+N with ij — £ + N > ij + 1. Once more 
if —£ + N G «fe} then we keep TNn+ij-i it in the expression of ONn+ij- Otherwise, 

i.e., ii ij - £ + N ^ {ij+l, ■■■,'ik}, then TNn+ij-i = TN{n-l)+ij-t+N > TNn+ij-i+N > TNn+ij-1 

and TNn+ij-i is deleted from the expression of 9Nn+ij- Thus we are done. 
Now the first equality of (4.11) yields: 

^Nn+ij = TNn+ij-i A TNn+ij-2 A ■ ■ ■ A TNn+ii A TNn+ik ^ 'TNn+ik-i A ■ ■ ■ A TNn+ij+i- (4-13) 
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Next by a backward induction argument we have that for any j G {1, • • • , k}, 

TNn+ij = ■TN(n-l)+ij = 'TN{n-2)+ij and 0Nn+ij = 0N{n-l)+ij- 

Actually for j = k, by (4.11) and (4.13) we have: 

fNn+ik — '^Ar(n-l)+ifc ^ ^Nn+ik = TNn+ik-i ^ '''Nn+ik-2 A • • • A TjVn+ii 

= '^Ar(n-l)+ifc_i A rjv(n-l)+ifc_2 A • • • A Tjv(n-l)+ii 
= 0N{n-l)+ik ■ 

The last equality holds true since by monotonicity we have 0jv(n-i)+jfc ^ ^Nn+ik ^-nd by 
definition 

Therefore by definition of riv(n-i)+ifc we have TNn+iu = '^N{n-i)+ik = TN{n-2)+ik ■ Thus the 
property is satisfied for j = k. 

Assume now that the property is satisfied for j = A;, + 1 (2 < ^ + 1 < A;) and let us 
show it is also valid for j = I. Prom (4.11) and (4.13) we have 

TNn+it ~ '^N(n-l)+ii ^ dNn+ie 

and 

(^Nn+ie = TNn+ie^i A Tj^n+ie-2 A • • • A T]\fn+ii A T]\fn+ik A T]\fn+ik-i A • ■ • A TjVn+i^+i- 

On the other hand 

^N{n-l)+H = '''N{n-l)+ie-l A Tjv(n-l)+if-2 A • • • A Tj^^n-l)+ie-N+l 

= TNn+ie-i A ... A TNn+h A Tjv(n-l)+ifc-Ar " ' ' A Tjv(n-l)+i^+i-A?"- 

This second equality is obtained in the same way as in (4.12) in using (4.11) and the 
induction hypothesis. Therefore, once more by the induction hypothesis, we have: 

^N{n-l)+ie = TNn+ii_i A ... A TNn+h A TNu+i^ ' ' ' ^ ^Nn+ie+i 
= &Nn+ie- 

It follows that 

TNn+it — '''N{n-l)+ii ^ ^Nn+ie = 0N{n-l)+H 

and then Tjv(n-i)+i^ = TN(n-2)+ie- Thus the property is satisfied for £. 
Therefore for any j € {l,...,k} we have 

TNn+ij = TN{n-l)+ij ^ &Nn+ij = &N{n-l)+ij 
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which imphes that An C A^-i, for any n > 1 and then P(An) = for any n > since 
P{Ao) = 0. □ 

Step 2: To proceed let n > and £ > 0, then we have: 

E[{Yi* -Qt;) a{i:-;=T4=...=T*^<Rj}] < 

k 



A; 



k 

^ J, ^1^J {Y^^-Ql^^>l;Y^i-X^,>S■,T;^=T*^=■■■=T*^<R*■,TNn+iJ<eNr.+^^r 

k 

Therefore, in taking into account (4.10), we have: 

^[O^T* ~ Qt*) =!;*=•• •=T* <R*}\ ^ 

k 

^E[(F^, -Q\.*) ^{Tl<R*;R*<TMn+iA\ + 

i=i ' 

i i T. T. I 

Now taking first the Umit as n — cxd and using the second property of Lemma 4.3-(ii) 
for the third term of the right-hand side, then taking the hmit as e — > to obtain: 

k 

E[{Y^* - Qt*) '^{t*^=t*^=...=t*^<r*}\ <Y,^\-0^t* - Qh) 

But by Assumption (A4) we have E[(Yj.* — Qj^*) l^^^j _ot*<t}^ ~ ^ therefore 

-E[(^^* ~ Qt.*) -"-{t* =t.* =---=t.* <iij}] ~ and £^[(1^* — Qj^*} ^{t*=r*<t}] ~ 
which completes the proof of (4.9). ■ 

We are now ready to give the main result of this paper which is a direct consequence of 
Lemma 4.3- (ii). Proposition 4.1 and the fact that > for any i e J'. 
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Theorem 4.2 Under assumptions (A1)-(A4), the N-uplet of stopping times (Tj*)j=i^...^7v 
is a Nash equilibrium point for the N-player nonzero-sum Dynkin game associated with 

Remark 4.3 Note that {T*)i^j and ( Jj(r*, r|, • • • , T^))i^j do not depend on the processes 
{Qt)t<T for any i E J'. On the other hand the NEP of a Dynkin game is not unique. Actually 
assume that for any i E J and t < T, XI = ^ and Q\ = = 1. Therefore one can easily 
show, directly or in using Proposition 2.1, that for any to € [Oj^]; (iO)"-)io) is a NEP for 
this game and Ji{to, ...,to) = 1, G JT". ■ 

Finally we have the following result related to Proposition 2.1 which is a direct conse- 
quence of the fact that {T*)i^j is a NEP for the nonzero-sum Dynkin game and, Proposition 
1 and Remark 2.3 and Proposition 4.1. 

Proposition 4.4 For i E J, let us set: 

where R is the Snell envelope operator. Then {T*)i^j and {W^ , ...,W^) satisfy (i)-(iii) of 
Proposition 2.1. ■ 
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